Noise and Information 


Michael D. Godfrey 


Stanford University 
email:michaeldgodfrey@gmail.com 
August 2024 


Contents 

PUSACK ciasd ca cd ied ee dte a apesaletide toagat ey eee went pew ag ae Guedes i 
Mp PIIGRE, sno ies ae senses eoaentey Paw ops eee hee Cs Bee ele ease sree eas RES bese ew gets Ate 1 
Emery cri Manter 2. ds cos bn Ge bebe ie Goes EEE SG Boke GS BE had eRe Rees Pte esas 9 
Quantum Nature of Energy and Matter . .0.6..00 4 ee eee ee a eee te ee cee eee ewes 10 
RAGAN occa eee eee eee eee ae BOG DOR e Cale ye Rae awake dard oe aW Sas 10 
AMPA AN AMINEES elk scent nice Sb citd decane ldoalne eve a Mace leh og Neve Shida lug da te cult g rds baked hd Sibert sens 10 
Thermodynamic: Partition Pumetigi 2.065.026 5 6 od ee ee ie lab sia Wee wees Sled wel ERE Re ee as 11 
hs Grins iain QISCUEGGE gees ise, acess gee na eee Gus oa ede Gea wie Row whe Saket dase eee gion BoE Em 11 
IOAN ERO 25s aiato ind ere 3, aes Ob b-a, Oneal yids wae AS Re enlns wb ee eRe ew Biel aees 12 
Bis CL WME 056s g cecbicony gies Soest 8 ade ag cada Seg van ese ehh eine dag BAe GnRy 8 sh Shaga ong ih ighidcel gets 13 
Peopgsed! Dawe: choc ce icon HES toe Rose Re Pecadewsh webloee bad seadd eewaeee wurmaans as 13 
History ol Platick’s derivation: 2 oc cccccde eee fb beh wee sede cde Goa de Gob Sheree 16 
Intinoaetion of (uaritara THSGGy oes cose cas eek oe eee Sarg eee GONE Ade ee cee ee eS 17 
EGE StANSGICH ks ee ee eb ab Eh aS Eb de Se Re ee hh de Re ie ee eho Bode ee ee as 18 
CeO POG FURIE ns see aae be Seba Meee cs Sine belo ewlea eee we eee Sees owe banal 19 
Measurements of Black-Body Radiation «..:.0c.0.6.0. 2h tosses cee che ataeeeee aden. 22 
Emery EC i saat eos oo fear ee e Soe Rb Ue id ea er gdod te so eos ow Sardegna Ge nd le oe @ ep gdoa ear ss aus 30 
Measurement of Emerey Fluctuations <. o.00.c ee ie ee eee te ee ees ee die Se ee eee ewes 30 
space-Prequencye LaiiliZaiOt nocd caw ee ee da bee eee a eGo bE DEER Re Dae ER 30 
Wir: Bnéroy Requirements << ib ckc5 sc pe eee tee epee ee de ee hee a gee Gee abe ats 30 
Wrasse sesh ate eee a eeetiates Sat ote ne oe ae ae de ae Ma ee ea Ee Sate ag wa cere, os ane’ 31 
Derr OF RSE costes pie oe one sired eRe eR ereSieie bie kB ine bang. age g aa ee ee eae 31 
CMTS LONUE:. 95,5.c6.6 so, oboe) one Soe ne Sue esheets doe Gea ooe Sable Gate grad Dee ah heeds Gl eg Sa ee 32 
Appendix: Haber Radiation Data. cc cocciue a cccaa dared Sande ad ea bok OG Gunma a dau sob eas 33 
| Ho) i025 1 6) |, ane eR oR a 35 


DRAFT: 31 August 2024 noise_and_info.tex printed on: 2 September 2024. 


DRAFT: 31 August 2024 noise_and_info.tex printed on: 2 September 2024. 


Noise and Information 1 


Abstract 


The Oxford Dictionary entry for “information” is: 


“What is conveyed or represented by a particular arrangement or sequence of things.” 


This appears to capture the definition in terms of both space and time and thus is 
appropriate as a technical definition. 


For (technical) “noise” the dictionary gives: 
“Trregular fluctuations that accompany a transmitted electrical signal 
but are not part of it and tend to obscure it.” 


This is not a very precise technical definition, but is a broad indication. The fluctu- 
ations do not necessarily accompany any signal. 


This report reviews the nature of noise and information. The following is a 
summary: 


Information bounds: Young’s Theorem 
Fisher Information: Provides the informational difference between measurements 


The Cramér-Rao bound states that the inverse of the Fisher information is a lower 
bound on the variance of any unbiased estimator of @. This is the same result as the 
information uncertainty limit in physics originally proposed by Born and elaborated 
as having physical meaning by Heissenberg, Born, and Bohr. 


Physical information consists of a determined arrangement of “matter-waves.” 
However, the formal meaning of a matter-wave is far from clear. Obviously, light 
encodes much of the information that we know of. Therefore, light must be included 
in the definition. de Broglie used the term “grain” for this purpose but this is not 
now widely used or even known. Information may, for example, take the form of 
marks on paper, the orientation of a magnetic dipole, the charge on a capacitor, the 
arrangement of atoms or particles, or provided by selected properties of waves such 
as orbital angular momentum. 


The formal logic of information was defined by Boole [5]. An interesting develop- 
ment of the logic with specific reference to practical applications such as in electronic 
circuit design is given by G. Spencer Brown [10]. The character of information pro- 
cessing in the presence of noise was established by Shannon [90] [91]. 


Information may be transmitted by means of matter-waves in the form of radiated 
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energy. The energy wave-packet may be thought of as yielding the information as a 
result of a transaction that alters the state of matter at some destination. 


The amount of information which can be stored or transmitted is limited by the 
degrees of freedom of a matter-wave and the limited frequency of the matter-waves, 
and by the fact that all measured energy is subject to unintended fluctuations due to 
the measurement. Thus, the study of information storage or transmission requires an 
analysis of the limits determined by the finite nature of matter and by noise fluctuation 
due to the measurement. Both classical thermodynamics and the quantum structure 
of matter contribute to the noise and noise fluctuation formulas. 


Radiated energy depends only on the temperature of the source and the wave- 
length of the radiated energy wave-packet (Kirchhoff[44]). Thus, radiated energy is a 
general phenomenon of nature. 


In traditional communication theory the noise in a communication channel is 
assumed, or left to be measured experimentally. This provides useful solutions in 
specific cases, but it limits the ability to evaluate alternatives, optimize the system, 
or to find fundamental limits. 


The noise limit results of Johnson|[42] and Nyquist|64] that are used today are 
based on the equipartition of noise energy, ignoring the Planck radiation result. Ny- 
quist, in both his note|63] and his paper[64] gives the Planck result at the end, but 
comments “Within the ranges of frequency and temperature where experimental in- 
formation is available this expression is indistinguishable from that obtained from the 
equipartition law.” 


The standard interpretation of Einstein quantum fluctuation considers an emitted 
photon as having 2 degrees of freedom: an amplitude and a phase. This limits 
the information that is “provided” by a photon. However, Beth[2] in 1936 showed 
that photons have the property of orbital angular momentum (OAM) which implies 
additional degrees of freedom. This has been studied further by Belinfante[1] in 1940, 
Nagali[60] in 2009, and more recently by numerous people who are building optical 
transmission systems which realize, typically, 8 bits per photon. This demonstrates 
the fact that a photon can provide, equating degrees of freedom and bits, a large 
number of bits of information. It does not appear that this additional potential 
information is used by either natural (auditory or vision) systems. 


This work starts with the derivation of the Planck radiation formula, reviews 
the Einstein radiation fluctuation formula and investigates the consequences of these 
results for the storage, manipulation, and transmission of information. 
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1. Introduction 


Information is stored by the determined arrangement of things. It is transmitted 
by means of energy transactions. The possible arrangements are given by the degrees 
of freedom of the system. The number of degrees of freedom is bounded by noise. 


Comments concerning Information and its arrangement: 


The objective of the investigation is to find the conditions which 
apparently allow the construction of a perpetual-motion machine of 
the second kind, if one permits an intelligent being to intervene in a 
thermodynamic system. When such beings make measurements, they 
make the system behave in a manner distinctly different from the way 
a mechanical system behaves when left to itself. We show that it 1s a 
sort of amemory faculty, manifested by a system where measurements 
occur, that might cause a permanent decrease of entropy and thus a 
violation of the Second Law of Thermodynamics, were it not for the 
fact that the measurements themselves are necessarily accompanied by 
a production of entropy. 

L. Szilard(1929) [93] 


Our present treatment of error is unsatisfactory and ad hoc. It is 
the author’s conviction, voiced over many years, that error should be 
treated by thermodynamical methods, and be the subject of a thermo- 
dynamical theory, as information has been, by the work of L. Szilard 
[93] and C. E. Shannon [90]. (Cf. 5.2). The present treatment falls 
far short of achieving this, but it assembles, it 1s hoped, some of the 
building materials, which will have to enter into the final structure. 
J. von Neumann(1952) [96] 


Today we are beginning to realize how much of all physical science 
is really only information, organized in a particular way. But we 
are far from unraveling the knotty question: “To what extent does 
this information reside in us, and to what extent is it a property of 
Nature?” 

E. T. Jaynes(1990) [38] 


Today’s evidence suggests that the Universe is composed of discrete mass-energy 
objects. These objects have a characteristic “wave” behavior. While they are observed 
as waves, they, equivalently, propagate energy. They may also have various symmetry 
properties. For an early discussion of this see Beth [2]. 


! Section 5.2 in von Neumann, 1952 [96] 
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2 Noise and Information 
This has fundamental implications: 


e Measurements to an infinitely small scale cannot be possible using instruments 
which themselves are made of discrete particles and which can only measure over 
a limited bandwidth. Thus there is a fixed limit to the precision of measurements. 


e This also implies that using “exact” relationships, such as orthogonality, is inap- 
propriate. A set of measured points can only be viewed as having an approxima- 
tely orthogonal basis. The degree of approximation is related to the size of the 
elementary objects and therefore is related to Planck’s constant, h. 


e The invariance properties which derive from the symmetry properties of objects 
determine the behavior of objects in space-time and determine the underlying 
physical constants. This was recognized in many specific cases starting with Bolt- 
zmann. The general theoretical structure was provided by Noether [61]. Much 
of the present understanding of the physical world has a long history. Hugyens 
[35] in the 17th century pointed out that the uniform brightness of distant stars 
implied that light is coherent: it arrived though free space unchanged. The impli- 
cations of this are still not widely appreciated. And, the central role of noise and 
information is of quite recent origin. The first substantial insight into the role of 
information was Szilard’s 1929 paper [93] (The English translation appeared in 
1964 [94].) This paper points out the essential role of information for the under- 
standing of the Maxwell’s Demon problem. Birkhoff and von Neumann in 1936 
[3] pointed out the need to understand the logic of experimental evidence. Subse- 
quent to this paper von Neumann intended to develop this reasoning much more 
fully.? Tragically, von Neumann’s untimely death prevented this. Much of Jay- 
nes’ work (for example his posthumously published book [39] or his “Probability 
in Quantum Mechanics” [38]) was directed to the same goal.? 


The presumption of the oscillator behavior of matter and the resulting random 
variation of radiation energy came from Boltzmann thermodynamics, and from me- 
asurements of radiation in the late 1800’s. Physical entropy was essential to un- 
derstanding radiation. Information entropy was only introduced in 1948 by Shannon 
[90]. However, the idea that matter is composed of discrete units originated in ancient 
science, based on the ‘rarification and condensation’ properties of matter. Schrodinger 
[89], pp. 54, provides a concise summary of this history. The observed contraction 
and expansion of matter could only be explained if it were made of particles which 


2 Miklés Rédei [81] and made clear in von Neumann’s correspondence also edited 
for publication by Rédei [80]. 

3 Jaynes made major contributions by demonstrating the role of LaPlace, or Bayes, 
probability in physical science, particularly in quantum mechanics. However, his 
strongly held view that only Bayes theory, in the form of the maximum entropy 
principle, was useful for the understanding of data samples did him and his underlying 
cause much harm. Simply put, sampling theory is useful in making inferences from 
samples. Jaynes claim that maximum entropy could find meaning in meaningless 
economic data was mistaken and damaging to his credibility. 
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could be spaced nearer or farther apart. 


However, only in 1900 was this converted to quantitative form supported by a 
substantial body of experimental evidence. 


The properties of noise and information derive from the basic structure of matter 
and energy. It appears that the description that is simplest and is most closely 
consistent with empirical evidence is that matter and energy are interchangeable. 
They are transmitted as wave packets. Wave energy, or radiation, occurs in discrete 
units. The elementary unit is given by Plank’s constant, h. The indivisibility of mass- 
energy leads to the view that energy is transmitted by discrete radiation transactions. 
See Cramer [14], Einstein [20] and Mead [58]. 


Today, all of physical science derives from these facts. In addition, since infor- 
mation is the determined arrangement of matter, indivisibility leads to limits on the 
amount of information that may be stored, gained by a measurement, or transmitted 
from one place to another. 


Planck’s discovery that black-body radiation is quantized opened a long debate 
about how this radiation comes about and how it was transmitted. The debate is far 
from over. Planck’s formula yields the mean energy density radiated from a body in 
thermal equilibrium: 


= hv hv 
k=— + a (1.1) 
ekT —] 


where F is mean energy density, h is a universal constant, v is wavelength, k is the 
thermodynamic (Boltzmann) constant, and T is the absolute temperature. 


1.1 Background 


There is no general agreement about the definitions of matter or energy, and how 
they represent or transmit information. Feynman’s view [26] can be summarized 
by quoting from his Chapter on Probability and Uncertainty concerning elementary 
particles: 


If I say they behave like particles I give the wrong impression; also if I say they 
behave like waves. They behave in their own inimitable way, which technically 
could be called a quantum mechanical way. They behave in a way that is like 
nothing that you have ever seen before. Your experience with things that you 
have seen before is incomplete. The behavior of things on a very tiny scale is 
simply different. An atom does not behave like a weight hanging on a spring 
and oscillating. Nor does it behave like a miniature representation of the 
solar system with little planets going around in orbits. Nor does it appear 
to be somewhat like a cloud or fog of some sort surrounding the nucleus. It 
behaves like nothing you have seen before. 
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There is one simplification at least. Electrons behave in this respect in 
exactly the same way as photons; they are both screwy, but in exactly the 
same way. 


The last paragraph above neglects the fact that electrons obey the “exclusion princi- 
ple” whereas photons do not. Therefore, the combinatorics of their distributions are 
different. As will be discussed below, this is essential to the derivation of the Planck 
radiation formula. 


Another attempt at simplification has been given by Resnikoff [82] as: 
e A photon goes from place to place. 
e An electron goes from place to place. 
e An electron emits or absorbs a photon. 


Be that as it may, information may be defined as the determined arrangement 
of matter. Communication may be carried out through the transmission of photons 
or electrons. Photons interact with electrons in ways that depend on the wavelength 
of the wave packets. One interaction, which provided convincing evidence of quan- 
tization, was the Compton Effect in which photons interact with matter to deflect 
electrons and produce scattered photons of lower energy according to the relationship 
E = hv. These experiments were reported by Compton in 1923 [13]. 


This description does not make clear the nature of the photons or electrons. 
Historically, there have been two broad schools: the quantum physicists who believed, 
as did Bohr and Heisenberg, that the elementary objects were “particles,” and the 
electrical engineers who believed that they were “waves.” It is claimed that this 
disagreement delayed the development of masers and lasers by 20 years. Physicists 
believed that the particle nature of matter and the Heisenberg information limit made 
it impossible for masers or lasers to transmit over any significant distance. Therefore 
they, including von Neumann, refused to support laser research. 


Recently more attention has been given to the physical representation of “in- 
formation.” This is a complex issue. Matter can be used to store or communicate 
information in a great many ways. Marks on paper, sound waves, visible light are 
everyday examples. In electronic systems, collections of electrons are stored in fields 
or transmitted through conductors. In classical optics incoherent light, composed of 
photons, is transmitted through lenses. It has long been believed (See for example 
Gabor [29]) that a single photon provides a single bit of information. However, this 
was shown to be over simplified as long ago as 1909 by Poynting [77] in theory and 
experimentally by Beth in 1936 [2]. The number of bits that can be encoded in the 
orbital angular momentum modes of a photon is indefinite. The practical number 
appears to be an “engineering” issue concerning reliability and complexity of the 
encoding and decoding mechanisms. It apparently is not known whether biological 
systems sense more than one bit per photon, or if so how this information would be 
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retained and interpreted. 


In addition, it has been assumed that the “noise” in the communication system 
is introduced in the channel, not in the transmitter or receiver. Thus, Resnikoff [82] 
(pg. 399) states: 


A communication system, according to Claude Shannon, consists of an infor- 
mation source, a transmitter, a noise source, a receiver, and a destination. 
The task of the transmitter is to encode the message provided by the informa- 
tion source and to modulate it onto the communication channel. The receiver 
detects, demodulates and decodes the message for the destination. The noise 
source acts on the signal while it passes from the transmitter to the receiver, 
that is, while the signal is in the communication channel. In fact, the trans- 
mitter and receiver will also be sources of noise but we will ignore this aspect 
of the system. 


In practice this was an appropriate description. However, using today’s optical 
communications the reverse is true. The “channel” is coherent (noiseless) but at least 
the receiver introduces noise. 


1.2 Purpose 


A purpose of this paper is to derive the black body radiation formula in a simple, 
but complete, form. We include a review of the history of derivations and of the 
experimental evidence which led to the correct formula. 


Well before 1900 it had been observed that matter emits and absorbs electroma- 
gnetic radiation. In 1860 Kirchhoff [45] [44] made a key discovery: black-body radia- 
tion can depend only on temperature and wavelength. Thus, black-body radiation has 
a very general character: it applies to all matter independent of the properties of any 
specific matter. This made it clear that the relationship of radiation to temperature 
and wavelength was of fundamental importance. 


This stimulated attempts to determine the law that governed the frequency de- 
pendence of radiation energy. At least three laws were proposed: the Wien law,the 
Rayleigh-Jeans law, and the Thiesen law. The first two of these laws had suppor- 
ting arguments, based on classical mechanics and Boltzmann thermodynamics. The 
Thiesen law was an empirical attempt to encompass all the other laws. 


At this time, intensive efforts were undertaken to measure radiation from sources 
that were thought to be in thermal equilibrium. The measurements were made over 
a range of temperatures and frequencies. Experimental techniques in the late 1800’s 
improved the measurements, permitting measurements over a wider frequency range 
[86] [53]. By 1900 it became clear that the proposed laws did not match the data, 
particularly at longer wavelengths. This led Planck to identify the formula which fits 
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at all wavelengths and, incidentally, made use of the quantization constant h, which 
Wien [97] had already introduced (without recognizing it as leading to quantization). 


Radiation is quantized: it is transmitted in discrete quantum units. The energy 
is described by Maxwell’s equations. The minimum energy radiation wave packet is 
a single photon. A model for the radiation mechanism is an oscillator. The abstract 
oscillator may either emit or absorb radiation wave packets. The quantization theory 
implies that the oscillator emits a wave packet with energy which is a multiple of the 
the fundamental unit of energy. A fundamental result of Boltzmann thermodyna- 
mics is that the density of states decreases exponentially with increasing energy. As 
Feynman ([27], Sect. 41) shows, this is the only result from thermodynamics which is 
required in order to determine the energy distribution as a function of frequency and 
temperature. Each energy packet has a characteristic frequency. The maximum fre- 
quency is bounded due to quantization. This also means that at most a fixed amount 
of information can be stored or transmitted by a fixed amount of matter /energy. 


It was the discovery of how the mean energy emitted by a source varies as a 
function of frequency that led to the discovery that radiated energy is quantized in 
a precisely defined manner. At this time, there was considerable uncertainty about 
the origin of the quantization. It was not generally believed that matter and energy 
were equivalent. Planck believed that only the radiation was quantized, while many 
others adopted the view that it was the quantization of matter that gave rise to the 
quantized radiation. 


When these laws are presented in current textbooks they are, typically, just sta- 
ted, or a thermodynamic explanation along the lines of Einstein and Bose is given. 
Feynman [27] Sect. 41, takes a different approach which starts by evaluating the 
energy as the sum of the energies over all states. The resulting power series is the 
expansion of the Planck formula. Kittel and Kroemer [46] use the same approach in 
their exceptionally clear textbook. 


However, some substantial uncertainties remain. The “zero-point energy” was 


initially neglected. Both Planck in 1911 [75] and Einstein in 1913 [25] point out the 
need for the zero-point term. Einstein, however, promptly repudiated his paper (see 
Section 2.4). In any case, the zero-point term is widely neglected in contemporary 
presentations. And, the verification, interpretation, and consequences of the energy 
fluctuation law are not well-established. 


The outline chronology of the main events leading up to Planck’s discovery is: 


1859 Kirchhoff proposed the law: E,A, = B(T,v), where v is the radiation fre- 
quency, EF, is the mean energy per unit time emitted by a source, A, is the 
absorption coefficient of the source, and B(T,v) is a function of the sour- 
ce temperature JT at each frequency v. This established the fundamental fact 
that the radiation energy is a function of temperature only. Thus, the problem 
was: what is the correct function B(T,v)? The “perfect” radiator, termed a 
black-body, has absorption coefficient A = 1. It was initially thought that a 
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radiation source could be in thermal equilibrium with A > 1, but this is not 
the case, since A 4 1 implies a source or sink. 


1893 Wien proposed the law: E(v) « e~'”/*T, This law fit the then available data 
(only relatively short wavelengths) and satisfied Kirchhoff’s result, but had 
no other theoretical justification at the time. Note that this law uses h, and 
that the numerical evaluation of h using this law yields the correct value for 
Planck’s constant. 


1893 Stefan’s law states that the radiation energy density is proportional to 7%, 
where T’ is the temperature of the radiator. 


1897 Rubens and Nichols reported new radiation measurements (subsequently re- 
ported by Jammer [37] pg. 388). 


1900 (February) Rubens and Kurlbaum [85] extend measurements at the wave 
length of light (A) up to A = 50y. These and results by Lummer and Pring- 
sheim [51] and [50] convinced many that the Wien formula was incorrect at 
relatively high temperature for \ exceeding even about 4 or 5. 


1900 Based on this experimental evidence, Planck found the correct law. Rubens 
reported to him that, over ranges of wavelengths and temperatures that he and 
Kurlbaum had recently measured, the radiation density was a linear function 
of temperature. By the next day he found the relationship oh 


1900 Rayleigh and Jeans developed their radiation law based on classical Maxwell 
electromagnetism. 


1902 Rayleigh acknowledged that the Planck formula “seems best to meet the ob- 
servations.” This appeared as a footnote dated 1902 to his 1900 Phil. Mag. 
paper [78] as reprinted in his collected works [79]. 


1905 Jeans paper appeared, correcting the constant term in the Rayleigh-Jeans 
formula. 


1911 Planck [76] revised his derivation to include the “zero-point energy” term. 
1913 Einstein and Stern [25] provide another derivation of the “zero-point energy” 


term. However, at the Solvay Conference later that year Einstein argues that 
his derivation cannot be correct as it leads to impossible infinities. 
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2. Energy and Matter 


After a long period of slight progress, the explanation of the behavior of ener- 
gy and matter which could be shown to be consistent with experimental evidence 
came about in 1900. This happened in large part due to the rapid improvement in 
experimental techniques. The key experiments were the measurement of black-body 
radiation at an increasingly wide range of frequencies. And, in particular, the disco- 
very that there was a significant range of frequencies within which the radiation was 
a linear function of temperature. However, the correct understanding also required 
Boltzmann’s thermodynamics. 


The probability of each energy state, based on the Boltzmann partition function 
(Huang[34] Section 8.3, or Kittel[46] Ch. 3), is P(E,) = ae~£"/*". This result applies 
equally to classical and quantum systems. For a quantum system the only new 
assumption is that the possible energy states are integer multiples of the energy 
quantum: E, = nhv. 


In 1900 Planck|70] determined, and subsequently justified, the radiation formula 


hy 


—— el /kT _ 1? 


(2.1) 


where F is the average energy, h is the fundamental quantum constant (Planck’s 
constant), v is the frequency, k is the Boltsmann constant, and T is the absolute 
temperature. Subsequently, in 1911/75], he proposed a new formulation which leads 
to the additional term hy /2 which leads to 


rnd (2.2) 


= aypek =” 9 


This result, however, implies a non-zero energy at zero temperature. Einstein[25] 
discussed this in 1913 and showed that this result leads to the correct energy value 
as T’ — oo. However, very shortly after publication Einstein said that he not longer 
held the views express in it due to the fact that the result, due to its implication of 
zero-point energy, led to singularities and, in his term “contradictions.” The issue of 
zero-point energy remains unresolved today. However, it is clear that the only form 
of the Planck formula which is consistent with theory and measurement is that given 
in 2.2. 


This will be discussed further in Section 5. 
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3. Quantum Nature of Energy and Matter 


In this Section we derive Planck’s radiation law[72] (See eq. (3.10) (eq. 1.35 
in [72])) and the radiation fluctuation law derived by Einstein|20]. There have been 
numerous presentations of these results but the only that I have found which combines 
brevity and a clear exposition of the physics is from the Feynman Lectures on Physics, 
vol. 1, chap. 40[27]. I have attempted to follow the spirit of his presentation. 


3.1 Radiation 


In December 1900 Planck deduced the correct expression for black body radiation 
from new experimental evidence, and concluded that radiation is emitted in “quanta.” 
Thus, without intending to, he confirmed the particle nature of matter and its scale 
parameter, (A). In 1901 he completed the derivation of the radiation law from a 
thermodynamic entropy argument. In 1905 Einstein used this work in his derivation 
of the photoelectric effect, thus establishing the particle nature of light (photons). 
The elementary Planck oscillator is naturally characterized by its amplitude and 
resonant frequency. Planck believed that only the emitted radiation was quantized. 
Einstein showed that the oscillator itself was quantized. The question that remains is 
how to understand and use the energy, frequency, and fluctuation behavior of these 
oscillators. 


3.2 Thermodynamics 


Thermodynamics deals with the behavior of matter as a function of temperature. 
It is the thermodynamic behavior of matter that gives rise to radiation. Thus, signals 
and communication are thermodynamic. 


Before Planck discovered the nature of “black body” radiation, the problem that 
he, and everyone else, faced was the “ultraviolet radiation catastrophe.” This was 
the realization that if the source of observed radiation was a continuous medium, the 
radiated energy would increase without bound as the wavelength was reduced to zero. 
Measurements showed that this did not happen and, obviously, it would be a cata- 
strophe if it did. Instead, the energy reached a maximum and then decreased toward 
zero as the wavelength approached zero. It occurred to Planck that this behavior was 
consistent with radiation occurring at fixed energy values. The elementary radiation 
source would only radiate energy in a discrete amount at fixed wavelengths. This is 
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formalized as 
En = nhy (3.1) 


where €,, is the energy, n is number of units (quanta), h is the fundamental physical 
energy constant (J-sec), and v is the wavelength. n takes on positive integer values, 
including zero. We have left out the zero point energy term phy. The value of h, 
the fundamental constant of matter, is computed from radiation measurements and 
is 6.6261 x 1074s. This value determines the “scale” of all particle matter. As a 
result, the “fundamental wave diameter” is 3.2 x 10~8cm. This is the typical crystal 
lattice distance and thus is the natural “size” value for matter. If Planck’s constant 
were a lot bigger, the world would be a much different place! If h were twice as big 
there would, leaving temperature and Boltzman’s constant fixed, be practically no 
radiation in the visible part of the spectrum. Biological systems would have had to 
develop with light sensors with sensitivity at much higher frequencies. 


A useful reference for introductory quantum thermodynamics is Kittel [46], 


3.3 Thermodynamic Partition Function 


Boltzmann showed that the probability of an energy value ¢€ is given by the 
Boltzmann factor, P(e) = e~</*7. 


Writing 
ZiT) => ee, (3.2) 
nm 


and using the fact that the probabilities sum to one over all states, gives the partition 
function 
even /kT 


P(én) = —z—- (3.3) 


3.4 The Quantum Oscillator 


Now consider a “quantum oscillator” where the quantum number n, Planck’s 
constant h, and v determine the energy €n according to 


En = nhv. (3.4) 


The sum of the probability elements, 
Z _ ye, (a0) 
n 
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converges to 


1 


Therefore, the probability that the system is in state n with energy nhv is 
e~ hy /kT 


P(n) = Z 


(3.7) 


Thus, the average value of n is 
= 1 
n= ye nP(n) = Z S° peer, (3.8) 


Evaluating this summation leads to 


_ 1 
— ehu/kT _ 1° 


al 


(3.9) 


This is the Planck distribution function for the average number of photons in a single 
mode of frequency Vv. 


The average thermal energy in the mode is 


This elementary oscillator (the Planck oscillator) may be viewed as the basic unit 
of physical state and of communications. Such oscillators are localized in time and 
frequency as the smallest units which represent distinguishable radiation sources. 


Bose [7] proposed that cells made up of Planck oscillators were the units that provided 
statistical independence. 


4, Maximum Entropy 


From Kevin Brown’s Mathpages (http://mathpages.com/): 


(URL: http://mathpages.com/home/kmath552/kmath552.htm) 


A certain professor of thermodynamics was known to give the same final exam 
every year, always consisting of just the single question: “What is entropy?” 
One day an assistant suggested that it might be better to ask a different 
question now and then, so the students wouldn’t know in advance what they 
would be asked. The professor said not to worry. “Its always the same 
question, but every year I change the answer.” 
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5. Black-Body Radiation 


As mentioned in the Introduction, black-body radiation became a subject of se- 
rious study in the mid 1800’s. After Kirchhoff’s 1860 [45] result that the radiation 
appeared to be a general phenomenon, interest focused on the behavior of the radia- 
tion as a function of temperature and wavelength. This led to Planck’s fundamental 
result. Note, however, that Kirchhoff’s result has been widely misunderstood due to 
the fact that its restriction to black-bodies is ignored. See Robitaille [84], 


5.1 Proposed Laws 


By the late 1800’s 3 main laws were in use: 


- 8rhv> 1 
Wien E(v)dv => "gs ey (5.1) 
2 
Rayleigh-Jeans E(v)dv = Sri" KTdy, (a2) 
Cc 
Thiesen E(X)dd = T?)(AT) (5.3) 
— yy (%m 1- SR)" 
OAT) = ¥n( SHe sf 5>a>2 


where E(w) is the mean radiation energy density, w is frequency in cps, (w = 27, 
where vy is frequency in radians), is the wavelength of light, (A = 27c/w), c is the 
speed of light, k is Boltzmann’s constant, T is temperature (Kelvin), h is Planck’s 
constant (discovered by Wien), and h = h/2zm. For the Thiesen 1900 [95] law, zm, 
and a are constants to be determined, and yw, is the maximum attained when AT is 
a maximum. This law, for suitable choices of the parameters can be made to behave 
like the Wien or Planck laws. However, it has no theoretical motivation. 


In October 1900 Planck [70] presented the law: 


= 8rhv 1 
E(v)dv = 3 chv/kT — {™ (5.4) 


where Planck used pu, forE(v). (U is a more common notation for the average energy, 
but helps to make clear that this the average value of the energy.) In December 1900 
[72] Planck provided a derivation based on Boltzmann thermodynamics. It quickly 
became evident that the Planck law fit experimental results more exactly than any 
of the alternatives. 
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These formulas are frequently expressed in terms of I(v), the mean light intensity 
at v. The mean energy density as a function of I(v) is 


E(v)dv = “TH v)av, (5.5) 


Formally, the step from Wien to Planck looks simple, but it was revolutionary 
because it was the first law that explicitly depended on the quantization of radiation. 
While Wien made use of h, which became known as the Planck constant, it was Planck 
who realized that it was the unit of quantization of energy. Einstein completed the 
development by realizing that energy and matter are exchangeable and that, therefore, 
matter and light are quantized. 


Each of these formulas represents the black-body radiation energy density (F) as 
a sum over all energy states of the radiation source. This view is most clearly given 
by Feynman 1963 [28]. However he did not include the Wien formula. 


Rayleigh-Jeans assumes that the density of the continuously variable radiation is 
equal for all states. The continuity assumption was required in order that equilibrium 
leads to constant density; Wien assumed that there exist radiation sources with den- 
sity given by thermodynamics, but that each radiation source has the same energy; 
finally, Planck assumed that energy sources exist with energy which is a multiple of 
the Planck constant. After he had discovered his law by other means, he derived 
it through thermodynamic arguments. These arguments were further developed by 
Einstein and Bose and provided the foundation of quantum theory. 


The relationships between the laws can be clarified by making use of the power 
series 


1 (oe) 
or Phe (5.6) 
n=0 
Take 
s=l+agt+a*+s?+--- (5.7) 
Then, 
se=a+a?+e°4--- 
e=ec = 1 
and, 
1 
— 5.8 
a a (5.8) 
Substituting « = eet gives 
1 ae 
a = doe. (5.9) 
en — J] n=0 
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Thus, the Wien law is just the n = 1 term of the series expansion form of Planck’s 
law. Each subsequent term provides the contribution to the radiation of energy from 
sources containing the multiplier, n, for n = 2,3,4,... 


It is much simpler to start, as Feynman does, from the density distribution of 
states which, using the summation over all states, leads to 


Etot — Nohw(0 +x + 2x? + 303 + ---) 
Not No(lt+tat+a24+a3+---) 


(5.10) 


where Vp is the mean number of oscillators in state 0, Lye is the total energy, Niort is 
the total number of oscillators and x = e~"/kT, Since 
be 


2 3 — 
O+2z T 22 T 32 t iene ers (5.11) 
and ; 
Lee pe ees ; (5.12) 
=i 
O+a¢+ 2x7 +303 +--- 
(O+z E £ I a (5.13) 
(l+2+a?+23+4---) l-<x 
And then, 
— hw 
L=—, (5.14) 
ekT — | 


However, Planck believed that the mechanism which generated the energy was 
continuous, only emitting a “quantum” of energy when a discrete energy level was 
reached. Thus he always describes the quantum behavior as a “quantum of action,” 
not of matter. This view was in conflict with the view of states having energy in 
increments of hy. In any case, this was the start of modern quantum physics. It is 
still astounding to consider the generality of Planck’s formula and the fact that it uses 
just 2 universal constants: k, Boltzmann’s constant and h, the Planck constant. The 
generality is due to Kirchhoff’s result [45] which states that black-body radiation is a 
function of temperature only. The Einstein fluctuation formula is a direct deduction 
from the Planck formula and it has the same generality (as first emphasized by Gabor 
in 1950 [29]). 


The content and sequence of Planck’s publications have not been made entirely 
clear despite numerous subsequent reviews. In addition, the role of Rayleigh is not 
always made clear. Note that in 1902 he acknowledged that the Planck formula “seems 
best to meet the observations.” This appeared as a footnote dated 1902 at the end of 
his 1900 Phil. Mag. paper as reprinted in his collected works [79]. Jeans’ paper [40] 
appeared in 1905, correcting the constant term in the Rayleigh-Jeans formula. 


Referencing this work is complicated by the fact that the earliest papers frequently 
were reprinted in modified form and were also later translated. A standard sequence 
was to first publish in the Sttzungsberichte der Koniglich Preussischen Akademie der 
Wissenschaften zu Berlin and then in modified form in the Annalen der Physik. 
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5.2 History of Planck’s derivation 


The summary chronology is: 


Date Reference Notes 


7 Nov 1899: Planck [71 
21 Mar 1900: Planck [69] References [71]. These 2 papers derive Wien’s law. 
19 Oct 1900: Planck [70] First statement of law. References Planck [69]. 

This is a 3 page paper. 

14 Dec 1900: Planck [72] First derivation based on Boltzmann’s S = k ln W. 

The above 2 papers are translated in Haar [31]. 

7 Jan 1901: Planck [73] Restates [70] [72] for publication in Ann. Phys. 
But, also uses the expansion ey = 57 le) 
for numerical evaluation. Planck did not notice 
the connection of this expansion to the energy states. 
This connection has been attributed to Ehrenfest [15] 
(See Kojevnikov [47] pg. 198). It also appears 
as part of the summation over all states argument in 
Einstein [19] 1907, in Sommerfeld [92] 1911, and in 
Wien [98] 1915. 

9 Jan 1901: Planck [74] Restates pp. 244-255 of [72] for publication in Ann. 
Phys., and provides additional numerical results. 

1911: Planck [76] Published his “revised” formula which 
included the zero-point energy term. 
1913: Einstein [25] Published his derivation of the zero-point energy term. 

But, a few months later at the Solvay Conference he 
withdrew his paper as untenable due to “implied 
singularities.” 


Notice that Planck [73] republishes Planck [70] [72] up to the last 2 pages while 
Planck [74] republishes the last 2 pages of Planck [72]. Planck [73] and [74] appear on 
contiguous pages in the Annalen. Planck [74] provides the key results on pp. 244-245. 


The Kirchhoff result provided the incentive and new measurements of radiation at 
longer wavelengths by Rubens and Kurlbaum, and Lummer and Pringsheim in 1900 
[85] [53] which provided the data that led Max Planck to the discovery of the correct 
formula for black-body radiation [71] [69]. The final key clue was when Rubens showed 
Planck their latest data, subsequently published in Rubens and Kurlbaum [85], and 
pointed out that the radiation energy, over a range of temperature values, was a 
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linear function of temperature. Planck found that —2“~ satisfied this condition. 
ekT —1 

There appears to be no explicit mention in the literature, but it seems probable that 

Planck realized that for the values of h,v, and T used by Rubens (i.e. values such 


that the approximation e” + 1 + a is valid) 


hv hv 
kT — 1 — 5.15 
: KT’ ane) 
and that therefore 
1 
hv x se (5.16) 
ekT — 1 


Both Pais 1982 [66] and Born 1935 [6] give detailed historical accounts of the 
development of understanding of black body radiation. 


At this point there remained three main problems with the Planck formulation: 
1. The question of the use of classical or quantum thermodynamics to justify the 
Planck formula, and of the independence or “indistinguishability” of the elemen- 


tary oscillators. 


2. The question of quantization of matter and, therefore, the equivalence of energy 
and matter. 


3. The failure of the Planck formula to yield the correct result for T’ — oo. 


5.3 Introduction of Quantum Theory 


Einstein in 1905 [18] and 1909 [20] stated that matter as well as radiation are 
quantized. He also, in the second reference, derived the expression for the mean 
fluctuation of radiated energy. 


At this point (1909) the radiation behavior of matter and energy was established 
by the Planck formula for the mean value of black-body radiation and the Einstein 
formula for the radiation fluctuation expressed as the second moment of the energy 
density. 


However, the theoretical explanation of these facts was still incomplete. The first 
“summation over all states” argument, using the series 


eT EP 4 26728? 4 36738 4, (5.17) 


appeared in a paper by Einstein in 1907 [19](See pg. 183). However, he used the 
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expansion as a means of evaluating the expression 


_ FE 
f Ee FP w(E)dE 
fe-Rr EdE 

And then discussed its interpretation as a sum over the energy states, but this inter- 
pretation did not appear to have much impact. Papers by Sommerfeld 1911 [92], and 
Wien 1915 [98] also make use of the series expansion. Planck and others seem not 
to have accepted this derivation since it depends on counting the number of “oscilla- 
tors” at each energy level and therefore depends on the quantization of matter. This 
derivation was only rediscovered much later, and attributed to Ehrenfest and Onnes 
1915 [17] [16]. While Wien makes use of the quantization of radiation, as did Planck, 
he also does not carry this though to the quantization of matter. The modern deri- 
vation using this method is most clearly expressed by Feynman 1963 [27] (Sect. 41). 
Feynman does not indicate a source for this result. It is possible that he thought 
it through for himself, or that he got it from Einstein. All of these summation over 
all states presentations are implicitly based on the expansion of aot: However, the 
form of the energy equation is = . Using this later expression leads to useful insight 
into the role of the zero-point energy term. See the following Section (19) for more 
discussion of this point. 


E 


(5.18) 


The paper by Einstein 1917 [23] is widely referred to as the first convincing qu- 
antum theoretic derivation. This paper states that it is based on “considerations of 
Wien” but does not make use of the results in Wien 1915 [98]. It does refer to Einste- 
in’s 1916 paper [22] as providing the first argument based on Wien’s considerations. 


5.3.1 Bose Statistics 


Bose’s 1924 paper [7] contradicted the arguments based on classical statistical 
thermodynamics. He introduced the classification based on “particles are indistin- 
guishable” as opposed to the classical arguments of “some form of independence.” 
Using this argument, Bose was able to derive the correct expression, including the 
constant term, for the Planck law. In addition, Einstein used the Bose definitions in 
1925 [24] to derive the fluctuation formula. 


This development led to controversy in several ways. First, the published paper by 
Bose |7] was Einstein’s translation into German of Bose’s original English submission 
to Einstein. Einstein made one substantial change to the paper. When evaluating 
the “number of cells” Bose first arrived at AnV ¥-dv, but this is half the measured 
value. Bose made an argument for multiplying this value by 2, but Einstein replaced 
the argument by a polarization argument. Bose had used a different argument (see 
Masters [57] pg.45). Masters says: 


“Bose later stated that, in his paper, he gave a quantum mechanical expla- 
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nation for the factor of two, but that Einstein removed it and replaced it 
with the polarization argument. While the original Bose paper in English is 
missing from the archives, it is likely that Bose postulated the light-quanta 
had an intrinsic spin with only the values of +h/27.” 


Bose’s original manuscript in English has not been found. It is quite clear that 
Bose was not happy with Einstein’s change and their relationship apparently deterio- 
rated. 


It is worth bringing up again here the fact that Einstein understood the derivation 
using the summation over all states only as a mathematical series expansion, NOT 
as a description of physics. Feynman and others saw the physics. 


In any case, these results satisfied the physicists of the time and the problem of 
black-body radiation was considered closed. Even so, the series expansion 


1 = _ nhw 
=\le (5.19) 
n=0 


im = 
ekT — 1 


was still viewed, in comments by Joffe 1911 [41] and others, as a mathematical fact 
without an important physical interpretation.! 


In addition, at this time no experimental evidence was available to support the 
fluctuation formula. The evidence today is far from convincing, as will be discussed 
below. 


5.4 Zero-point Energy 


Initially, the black-body radiation laws were proposed without consideration of the 
possibility of temperature independent radiated energy. This included both Planck’s 
and Einstein’s initial derivations of Planck’s law. Today the textbook presentations of 
the Planck radiation law generally ignore zero-point energy. However, in 1911 Planck 
[75] pointed out a need for the zero-point term hy /2. This requirement depended on 
Plank’s assumption of continuous absorption of energy. (See Mehtra and Rechenburg 
[59] pg. 95-96.) This happens since the quantization takes place only in the emission 
process. Based on this assumption he derived his revised, second, formula: 
hv hv 

+=, 


ekr —1 2 


B= 


(5.20) 


Subsequently, in 1913 Einstein and Stern [25] took up these results. Einstein starts 
by presenting “Planck’s first formula” and then “the second.” He does not specifically 


! A very helpful discussion of this issue is given in Kojevnikov 2002 [47] pg. 198. 
Note that he refers to “Ioffe.” This is actually Abram Joffé. 
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reference Planck’s earlier paper, but simply quoted what, for him at least, were known 
results. These results have been developed more recently, for example by Reynaud 
[83]. 

Einstein based his argument for the zero-point term on the expansion of e!”/T 
“truncating the expansion at the quadratic term.” Thus, using the expansion 


x x 


TW —s aa 
oar (5.21) 


where, to simplify the notation, « = hyv/kT, the first formula becomes 


hv 
lim FE = kT + — 5.22 
Tao at 2 ( ) 


and the second is 


lim E = kT. (5:23) 
T=00 
This is the correct thermodynamic limit. 


This is more easily shown by observing that while 


1 
li = 24 
20 et — 1 oe 


the limit for the energy expression, applying l’Hopital’s rule, is 


=1. (5.25) 


This leads immediately to the “second” formula. It was the use of the classical 
thermodynamic summation over all states argument rather than the direct evaluation 
of the Planck formula that gave rise to the omission of the non-zero T’ = 0 term. 


If we start from the energy equation, rather than the distribution function, we 
get 


| 
sO 
where B,, is the nth Bernoulli number, (Bo = 1, By = 3, Bo = a By= — 35: Bg = 
D> ... and Bani = 0 for n > 1). The first few terms of the expansion are 
y 4 6 
a Le x 
aay ee ee eo ey ee (5.27) 
and, substituting the B, values 
x 1 la? 1 x4 1 6 
=1-<294 - | boo 5.28 
em —] 2 "62 304! | 426 O28) 
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(Note that this expansion requires |x| < 27 for convergence.) In terms of the energy 
expression 


p=Kr( if ) (5.29) 


err — 1 (5.30) 
hv 
lim &=kT -—- —. 
=00 2 
And, for: 
hv hv 
= ee 
eir—1 2 (5.31) 
lim B= kT 
=00 


Einstein’s paper was submitted in December 1912. At the Second Solvay Conference 
in October 1913 [21] he said: 


“If we want to introduce a zero-point energy in Planck’s sense, then, in my 
opinion, we must not dispute the idea that it consists in motions, i.e., par- 
ticularly here, in elastic oscillations in Debye’s sense. This makes it more 
unavoidable for us to ascribe to this energy an influence on the intensity of 
Laue’s interference points. 


I must also note on this occasion that I no longer consider the arguments 
for the existence of zero-point energy that I and Mr. Stern put forward to 
be correct. Further pursuit of the arguments that we used in the derivation 
of Planck’s radiation law showed that this road, based on the hypothesis of 
zero-point energy, leads to contradictions.” 


The “contradictions” were mentioned by Einstein in a letter to Jordan in 1925 as 
described by Kojevnikov [47] (pg. 212). Kojevnikov restates the 2 points as: 


“the sum of the zero-point energies hy /2 for all oscillating modes would give 
an infinitely large contribution to the total energy, and, besides, the new 
procedure did not offer a way of deriving the other fluctuation formula 


W = (U/V)E/, (5.32) 
(Where W is the probability that the entire energy of radiation concentrates 
in the fraction U of the total volume V of the cavity.)” 


Kojevnikov [47] also (pg. 212) reviews the development of the matrix mechanics 
approach based on Jordan and Einstein’s objections. However, Einstein does not 
appear to have further elaborated his argument. 
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More recently, Boyer [9] has provided a detailed analysis of zero-point energy. 
This is the conclusion of a series of papers starting in 1969 [8]. Boyer points out that 
these results have not been included in recent texts. It is time for current physics 
texts to take account of these results. Boyer’s results depend on the Cassimir effect 
[12] which was not known to Einstein or others in the 1920’s. 


5.5 Measurements of Black-Body Radiation 


In the late 1890’s and early 1900’s the state of radiation measurement was greatly 
improved both in terms of temperature and frequency range. These developments are 
fully reported in le Chatelier and Boudouard in 1904 [48]. This publication includes 
a Chapter on black body radiation and includes a very brief mention of the Planck 
formula. 


During this period experimentalists, particularly Lummer and Pringsheim [51] 
used the empirical formula : 
E=Cxr *e or, (5a) 


where Ca, and ¢ are empirical constants. This was done in order to be able to fit 
a smooth curve to their observations. The constants were taken to depend on the 
material under test as well as temperature. This despite the fact that Kirchhoff’s 
law was well-known. For a = 5 and c = hc/k (the second “c” is not the c used 
in 5.33, but is the speed of light) this formula is the Wien law. This formula was 
used to fit numerous measurements, varying the three parameters to best fit data 
from experiments which used various materials and made measurements at various 
temperatures. This did not provide much theoretical insight until Planck found the 
right answer, which, obviously, is not a parametrization of 5.33. However, after 
Planck’s result was published, the formula 


a (5.34) 
eraT — | 

where a and b (6 replaced the c of equation 5.33) are again empirical parameters, was 
still used by Haber 1908 [32] and others. (Also note that the 6 in 5.34 is not the b used 
in the Wien displacement formula, which is usually written as Amaz = b/T, where 
b = 2.8977685 x 10° pmk and Amazx is the value of A at which the Planck formula 
reaches its maximum.) From the Planck formula, b = hc/k. Fitting the Planck curve 
to a set of radiation measurements was made much easier by simply finding the best 
value of b and the right scale parameter, a. The values of h, c, and k which were 
accepted in the early 1900’s were not close to the present value for b = hc/k = 14388. 
The accepted values did not yield a value of b that gave a good fit. There seems to 
have been no discussion of this in the literature. 


Figures 1 and 2 show the Rubens and Kurlbaum data that Planck saw. These 
2 figures were first published in Rubens and Kurlbaum [85] in October 1900. The 
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paper refers to the Planck formula, but the Figures were only updated to include the 
Planck curves in Rubens and Kurlbaum [86] in 1901, as shown in Figures 3 and 4. 
Figure 2 is also reproduced in Pais 1979 [65], pg. 367. 


These Figures all present measured mean energy plotted against temperature at 
a specific wavelength. These measurements introduced the technique of repeated 
reflection of the emitted radiation in order to isolate a specific frequency. They also 
introduced techniques which permitted measurements at longer wavelengths. It may 
seem odd that the vertical energy scale shows negative values. What is actually 
plotted is the relative energy centered on the energy at 0°C. This was evidentally 
done in order to facilitate comparisons of different measurements. 
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Fig. 1: Data from Rubens and Kurlbaum 1900 [85] (labeled: Fig. 2 in Figure) 
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Fig. 3. 
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Fig. 2: Data from Rubens and Kurlbaum 1900 [85], (labeled: Fig. 3 in Figure) 


In 1901 Rubens and Kurlbaum [86] republished these results after including the 
Planck formula. Figure 3 shows this updated version of Fig. 3 in [85]. 
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Fig. 3: Data from Rubens and Kurlbaum 1901 [86], (labeled Fig. 2 in Figure) 
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Fig. 4: Data from Rubens and Kurlbaum 1901 [86], (labeled Fig. 3 in Figure) 


The Planck formula and the supporting experimental results are summarized in 
Haber 1908 [32] in a form that is similar to many current presentations. His key 
figure, Fig. 16, was taken from Lummer and Pringsheim 1903 [55]. This Figure is 
an exact copy of Figure 2 from Lummer and Pringsheim including the fitted curve. 
Lummer and Pringsheim do not mention Planck or the Planck formula. In any case 
it is obvious that they simply fitted a smooth curve through their data points. Haber 
refers to “Measurements by Lummer and Pringsheim at known temperatures up to 
1500°” and further measurements “up to 2000°” using spectrum techniques. Haber 
did not give a specific reference, but this Figure appears in Lummer and Pringsheim 
in 1903 [55] [56]. The second reference [56] is the English translation of the original 
paper [55]. (There is one typo in the translation: in the Table at the top of pg 
675: the upermost entry in the column labeled 0.55y should be 2309.) Obviously, the 
Haber reference to 2000° is a typo. He meant 2300° as stated in the Lummer and 
Pringheim paper. 
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The Lummer and Pringsheim Figure is reproduced below as Fig. 5 (the Figure is 
a scanned image from the original paper), and, with recomputed theoretical values 
for the curves, in Fig. 6. These figures show the theoretical curves at 4 temperatures 
and show 23 measured values at 2320K. 


Fig. 2. 


1450° 


1215° 
9350 


Fig. 5 Early Measurement of Radiation at High Temperature 
(from Lummer [55], Fig. 2, pg. 10) — arbitrary vertical units. 


In previous papers the highest temperatures reported by Lummer and Pringsheim 
in 1899 [51] [50] are 1416K in the first paper and 1646(1653)K in the second. The other 
references that have been checked are: Lummer and Pringsheim 1899-1901 [51] [50] 
[53] [52] [49] [54], Paschen 1897-1901 [67] [68], and Rubens 1897-1901 [87] [88] [85], 
and [86]. The Haber Figure 16 is reproduced, with attribution “according to Lummer 
and Pringsheim,” in Born’s Atomic Physics (1935) [6], pg. 206, and described in more 
detail, including a sample of the data, in Pais (1979) [65], pg. 364-368. Born redrew 
the Haber Figure whereas Pais reprinted it from Haber. 


Neither Haber nor Born remark that the maximum of the curve for T’ = 2320.K 
appears to occur at the data point at about A = 1.266. The correct theoretical value 
given by 

Anan = b/T) (5.30) 
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is 1.249. However, Haber quotes Lummer and Pringsheim as having found that the 
constant factor, b, in equation 5.35 was 29404. Thus, Haber would have expected the 
maximum A to occur at 1.267~ which is very close to what the Figure shows for the 
highest data point. Neither Haber nor Born comment on the curve drawn through 
the points at all. 


In Fig. 6 the Wien formula and the Planck formulas are computed using first the 
current CODATA values of the constants and second using b = 14200, as must have 
been done by Haber. Lummer and Pringsheim 1901 [54] used plots like this from 
their measurements to show that at high temperature and longer wavelength (above 
about 2.5) the data are not consistent with the Wien formula. (See, in particular, 
Fig. 2, pg. 200 in Lummer and Pringsheim 1901 [54].) 


90 - 
80 + Temp(K): 2320, 1450, 1215, 935 
ele . (he/(AKT)) 
Planck Radiation Law: E(A) = (h c/A)/(e -1) 
70 
Constants (c, h, k) from 2008, Haber (b = 14200) 
Wien 

60 - Planck 
@ Planck: Lummer-Pringsheim 
o 
8 e (0) Observations from Lummer-Pringsheim (1901) 
> 
© 
s 
& 40 
= 
wi 

30 

20 

10 


Fig. 6: Early Measurements of Radiation at High Temperatures 
(Recomputed from Lummer and Pringsheim 1903 [55], Fig. 2, pg. 10) 
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The measurement of c, the speed of light, h, Planck’s constant, and k, Boltzmann’s 
constant was still an active subject of refinement at this time. While Einstein wrote 
the Planck law as 


L= = : (5.36) 
Haber and many others used “empirical” parameters and wrote it as 


1 
E=a\~° 


b 
exT — 1 


(5.37) 


This permitted the determination of values for a and 6 without necessarily deriving 
them from c, h, and k. The a parameter is just a scale parameter. The value of 
b is the problem: the shape of the curve is very sensitive to the value of b. Haber 
states that a widely accepted value of b when he wrote his lectures in about 1906 was 
14,600. However, this value was not used for the Lummer-Pringsheim Figure. The 
value b = 14,200 must have been used and this was used for Figure 6. Even a small 
change in this value causes the fitted curve to diverge from the data points for the 
values of A above 3. Using modern (CODATA) values of c, h, and & produces the 
curve shown in red in Figure 6. Experiments with the values of these parameters that 
were in use in the early 1900’s did not produce a good fit. 


While the curve shown by Lummer and Pringsheim was intended just to connect 
the points, a few comments about how well the points fit the Planck formula are in 
order. The temperature value which produces a maximum at the highest data point 
is T = 2250. This temperature value produces a curve which is quite far from the data 
points between A values of 3 and 4. It appears that the measurements were made at 
a temperature quite close to 2320K. Of course, the wavelength scale was fixed, and 
the maximum of the drawn curve is close the correct wavelength, so the goodness 
of fit does not contradict the Planck formula. The divergence of the data from the 
Wien curve is also clear. The use of this curve to “confirm” the Planck formula, as 
indicated by Haber and Born, was not due to Lummer and Pringsheim. 


The Lummer and Pringsheim experimental setup used a bolometer to measure the 
radiation intensity and optical spectrometry to separate the radiation as a function 
of frequency. 


The lower temperature curves are also a few percent above the correct value, 
using the same normalization that worked for the 2320K curve. The maxima of these 
curves seem to be at about the correct frequency. This is shown in Figure A.1 in the 
Appendix. 


Finally, the measured points for Lummer-Pringsheim which are shown in Fig. 6 
were determined by making a high-resolution scan of the original Figure from [55] 
and then rescaling this figure to match the figure that was generated by Octave. The 
coordinates of the 23 measured points were carefully adjusted to be centered on the 
plotted circles on the Lummer-Pringsheim figure. The plot in the Appendix shows 
this result. 
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6. Energy Fluctuations 


In 1909 Einstein[20] derived the expression 
Ae = @ + hve (6.1) 
for the fluctuation of radiated energy, based on the Planck formula. This result has 
the same generality as the Planck formula and therefore applies to all matter. Only 
two attempts at measurement have been recorded. These are [33] and [43]. The 
second essentially copied the methods of the first. The measured results, of only four 
data points, show errors of about 20%. 

The Nyquist|64] result for noise in a resistor simply uses equipartition of noise. 
However, both Nyquist and Johnson|42] were aware of the Planck radiation result. 
They both stated that for practical purposes at that time, equipartition provided 
sufficient accuracy. It appears that the value of this expression for establishing noise 


limits in both classical and quantum systems has not been appreciated. The promi- 
nent exception is Gabor|29]. 


7. Measurement of Energy Fluctuations 


Not completed. 


8. Space-Frequency Localization 


Not Completed. 


9. Minimum Energy Requirements 


Not Completed. 
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10. Information 


The relationship of physics, interpreted as concerned with the strictly physical 
world, and information, which is inherently more abstract is a strange one. But, as 
soon as a notion of order or arrangement enters into the problem then information 
becomes essential. This entered into physics through Boltzmann’s thermodynamics. 
Thermodynamic work is defined as the transfer of energy between two states. This 
can take the classical form of W = F x d, where W is the work done, F' is force 
and d is distance. Thermodynamic information is defined by S = kTlogeN, where 
k is the Boltzmann constant, J’ is temperature and N is the number of states in the 
system. (The actual units are Joules or ergs.) Information theoretic information is 
similarly defined taking N as the number of (binary) bits. Thus, information work 
can be defined in terms of the work required to transform one bit. 


10.1 Degrees of Freedom 


The concepts of symmetry and degrees of freedom are fundamental to all science. 
The Noether Theorem [61] provides the theoretical foundation for the role of sym- 
metry in physics. The existence of physical constants is determined by the invariants 
of the system as determined by the conditions of the Noether Theorem. Noether’s 
theorem is not widely discussed nor taught. Two useful references to the theorem 
and its applications in physics and physical chemistry are Callen[11] and Boeyens|4]. 
Geometrically, the degrees of freedom is given by the number of independent axes 
that describe the system. This notion seems intuitively clear for one, two, or three 
dimensions. Beyond that, trouble sets in. This is clearly shown by the following result 
due to Gabor[30]. (It appears that Gabor was not aware of the Noether Theorem.) 
He states: 


I have come to the conclusion, which I will sketch out only very briefly, that we 
communication-theorists have somewhat misled the scientific and engineering 
public. The statement N received data = N picture points is perfectly correct 
in a mathematically rigorous sense. It is the same as stating that in an N- 
dimensional space we can construct only N mutually perpendicular axes. But 
if one asks the question ‘how many approximately perpendicular axes can we 
construct in N dimensions?’ One comes to the surprising conclusion that one 
can construct the enormous number of: 


N! oN 
(GN!) (dm) 


10.1 


axes, with a mean square cosine between them of only 1/N. One can then show 
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that one can transmit almost N? picture points with a tolerable error) and this 
is what Wild[99/ has done by an ingenious phase-correcting method, followed 
by realtime computation. The paradox is perhaps not evident to everybody 
who reads his papers, because he processes his 8000 data in batches of 48, but 
this is only to save electronic equipment. In principle, using his algorithm, it 
could be done simultaneously. 


The limit of the mean square of the cosines between the axes is: 


; YS (cosdi)” < ! 10.2 


where @ is the vector of angles between the Ng approximately orthogonal axes. 


This analysis is right in a sense, but technically wrong in detail. In fact there 
is no fixed bound on the number of approximately orthogonal axes. This permits 
systems of N sample points to appear to have a much higher number of degrees of 
freedom based on this approximate measure. Since it is never possible to define the 
position and value of a measured point exactly, the appropriate degrees of freedom is 
also an approximation. The limit on the effective degrees of freedom is determined 
by the accuracy that is required for the final result. 


11. Conclusions 


In summary we have attempted to present a review of noise and information as 
presntly understood. Much more could and should be developed. We hope that this 
report may stimulate such development. 


DRAFT: 31 August 2024 noise and _info.tex printed on: 2 September 2024. 


Black-Body Radiation 33 


12. Appendix: Haber Radiation Data 


In Section 5(13) we discussed the experimental evidence for the Planck radiation 
law which was determined in the late 1800’s. The result that decisively affected 
Planck’s analysis was the linear dependence reported to him by Rubens (based on 
the results published by Rubens and Kurlbaum[85]). But, the data published by 
Lummer and Pringsheim in 1903[55] and reprinted by Haber in 1908[32] and by Born 
in 1933/6] came to play an important role. This was entirely due to the reprinting 
of the data. The sole purpose of the Lummer and Pringsheim paper in 1903 was to 
demonstrate their high-temperature technique. They made no mention of Planck or 
the Planck distribution. Both Haber and Born suggest that the curve was meant to 
demonstrate the the Planck formula. Lummer and Pringsheim simply drew the curve 
to connect the data points. The figure below is a rescaled overlay of Figures 5 (27) 
and 6 (28). 


The Lummer and Pringsheim Figure has some interesting features: 


1. Lummer and Pringsheim in 1903/55] provide details of their apparatus and me- 
asurement methods, but not the original measurement data. They do give some 
qualitative error estimates. 


2. The blue curve, labeled “Planck: Lummer-Pringsheim” is the curve that would 
have resulted from the accepted constant values at the time. This curve is fairly 
close to the curve drawn in the original Figure. However, there are obvious 
divergences. The most significant is the divergence at short wavelengths. It would 
have been expected that these would be relatively accurate. However, there is 
also some divergence of the last 4 data points on the right (longer wavelengths, 
where Planck’s law diverges from Wien’s). These data points lie between the 
theoretical Planck curve and the Wien curve (cyan). Someone strongly attached 
to the Wien law could have argued that neither curve fits the data exactly. This 
is made worse if the correct, by today’s known constant values, Planck curve is 
used (the red curve labeled Planck). For this case, the data lie about midway 
between the Planck curve and the Wien curve. 


3. Again, the original smooth curve through the data points was simply drawn by 
hand to connect the points. Lummer and Pringsheim did not mention Planck. 
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Fig. 2. 
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Figure A.1: Overlay of Planck theory curves on Lummer and Pringsheim Fig. 2 
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